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1. INTRODUCTION 

Minimal realization and model reduction [1, 2] are widely used to obtain mathematical 
representations of systems in state space form with the smallest possible number of states [3-7]. 

Many definitions have been given to realizations but generally speaking, a realization is the process 
of transforming exactly a system from its frequency based transfer function G(s) to a time based state space 
representation (A, B, C, D) : 


oe oeeene 


Y=CxX+D 
Cx +DU (1) 


Where U is the input vector regrouping m inputs. Y is the output vector regrouping with p inputs. X 
is the state vector with dimension n. A is an nxn state matrix. B is an nxm input matrix. C is a pxn output 
matrix. D is a pxm feedforward matrix. 

A minimal realization is a realization with a minimal order n called the McMillian degree. 
All minimal realizations are equivalent [3]. It is worth noting that a state space representation is a minimal 
realization of a proper rational function G(s) if and only if (A, B) is controllable and (A, C) is observable [3]. 

Beside time reduction in controller and observer designs [4, 5], minimal realizations in general have 
the advantage of reducing the cost of implementation of the state space equations in terms of electronic 
components. Different techniques exist for minimal realization. Each technique has its advantages and its 
disadvantages. Some techniques focused on obtaining the state space representation in a minimal time and 
other focused on the form of the matrices of the state space representation. Depending on the application, 
time efficiency or configuration of the resulting minimal realization may be preferred. This requires to have 
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tool that would allow researchers and engineers to easily compute minimal realization. Up to now such a 
complete tool could not be found in the literature. 

Many toolboxes have been implemented to help researchers and engineers in their work [8-14]. 
This MATLAB toolbox for minimal realization can be combined to other tools to design controllers and 
observers in an efficient way. Although a toolbox for minimal realization was presented in the past [15], 
it is incomplete as it presents only one method and is not user friendly as it does not have a graphical user 
interface (GUI). 

In this paper, first, the implemented minimal realization techniques are presented theoretically, then, 
the graphical user interface (GUI) is presented along with individual functions corresponding to the different 
minimal realization techniques. Finally, the GUI is tested using practical applications and different 
techniques are compared using the minimal realization toolbox. 

In the broad sense, realizations aim to obtain systems in state space representations even for raw 
input-output data. One of the most promising methods for data from requency domain and time domain, 
are the methods based on Lowener framework [6, 7]. These are also presented and implemented in this paper. 

The presented toolbox is valid for single input single output (SISO) systems as well as multi input 
multi output (MIMO) systems. It is also valid for continuous time and discrete time systems. 


2. PROPOSED PROCEDURES 

There exist many minimal realization techniques [16-18]. In this paper we distinguish two main 
categories: realization from a transfer function and realizations from data. In this section, we present the 
theoretical basis for the methods implemented in the toolbox. 

In 1963, Gilbert presented a method based on the partial fraction of the transfer function [19]. 
Although this method is interesting in terms of the resulting configuration, it is not general because it is not 
applicable to repeated poles. Thus, this method will not be detailed here. Another popular method is the 
Kalman decomposition method. The goal of this method is to obtain a minimal realization given a non- 
minimal realization. Other methods based on the Hankel matrix were presented in the following years. We 
present here two methods based on the Hankel matrix: the Singular value decomposition (SVD) method and 
the row searching method. Finally, methods based on coprime fractions of the transfer function are presented. 

Concerning the realizations from data, we present two methods based on the Loewner matrix. One 
method is a realization from frequency domain data while the other one is a realization from time 
domain data. 


2.1. Kalman Decomposition 

The Kalman decomposition method [20] is an indirect method which requires to have first a non- 
minimal realization to be able to compute the minimal realization. Once a realization is obtained, Kalman 
decomposition is used to separate the system into four parts: 
a) Accontrollable and observable part (c-o). 
b) A non-controllable and observable part (nc-o). 
c) Accontrollable and non-observable part (c-no). 
d) A non-controllable and non-observable part (nc-no). 

Kalman decomposition is obtained using a similarity transformation. After Kalman decomposition, 
the obtained system is in the form: 


7: ae Ay A, 3 Avy D4 
n 0 Ae 0 Ay, i By A as 
A= B= CAO Cte 00 Cas D=D 
0 0 7a eae As, 0 
0 0 0 A 0 
nc—-o (2) 


Since by definition a minimal realization is controllable and observable, only that part is kept. 
Using the form (2), the minimal realization is given by (3): 


Hirt 


Y=C_,X+DU 3) 


The main advantage of this form is the ability to use it when the given system is already in state 
space form but it is not of minimal order. 
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2.2. Hankel Matrix and SVD 
The Hankel matrix is defined as: 


H(1) (2) H(r) 
H(2) =H (3) H(r+1) 
= 
H(r-1) H(r) H (2r—2) 
H(r) H(r+l1) H(2r-1) (4) 


where H(i) are Markov parameters which can be computed from the transfer function as: 
G(s) = H(0)+H(l)s '+H(2)s~* +... (5) 


For SISO systems H(1) is just a scalar. 
Theorem I: A strictly proper rational function G(s) has degree n if and only if 


rank{T(n,n)}=rank{T(n+k,n+l1)} for every k, l=1,2...... 


Proof of theorem 1: [3]. 
There exist many methods based on the Hankel matrix. We present here two methods: one based on 


the SVD and the other one on row searching. 
In the first method, the singular value decomposition of the Hankel matrix (4) is computed: 


A 0), 
r=K{4 5) 
(6) 


By definition, K and Lare orthogonal and i aide ( Ay Ags+-sA,) where A; are the square roots 
of the positive eigenvalues of T’T . The rank of T can be deduced from theorem 1. 
oe oi T 
Let K denote the first n columns of K and / denote the first n rows of . Then T can be 


decomposed as: 


T = KAU = KA? A? = O¢ (7) 


* _ gla aT 
where O=KA"™ and G=A'L G Is the controllability matrix and is O the observability matrix. 
The resulting minimal realization is given by: 


A=O'TL* (8) 
B= First p columns of ¢ (9) 
C= First q columns of O (10) 
D=H(0) (11) 


This minimal realization is also called balanced realization because the controllability matrix a and 


the observability matrix O satisfy: 
! — ! 
¢'¢ =O0'0 (12) 
A modified version of this method is used in model reduction. 
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2.3. Hankel Matrix and Row Searching 

This method consists of searching for linearly dependent rows (columns) in the Hankel matrix. 
Because of the structure of the Hankel matrix and theorem 1, if one row in a block row is linearly dependent 
on its previous rows, then it is also linearly dependent on the subsequent rows in the same block row. 


Let ?? be the number of linearly independent rows in a block row 1 where i=1, 2..., a. Each 
primary linearly dependent row in a given block row will be written as a linear combination of its previous 
block rows. A primary linearly dependent row is the first linearly dependent row in a given block row. At the 
end, the outcome of the row searching algorithm will be the coefficients corresponding to the q primary 
linearly dependent rows: 


=| Gig Lic (oy, )1:0 2900 1202:24022.00.<,0'] 
iL acts (a3) Or aig (I exes, (ox) 02 0;.500,, 00) 


k, =| a,, (1)-.-dy,(o,) 02a,, (1) sai 6, OO ea (lucas, (a, )1...0| 


(13) 
Such that kiae , 
A minimal realization is given by: 
Ay, 0 0 b, h (0) 
A, Ay, b, h, (0) 
Ag Ayn Ag b, h, (0) 
(14) 
0 1 0 0 0 0 
0 0 0 0 0 0 
fori=j A,= ; es : , fori#j A,= 
0 0 1 0 0 0 
me (1) ~@; (2) ey (o ) Ga; (1) a; (2) a; (c,) (15) 
h, (0) 
h, (2) 
a 
hi, (o I ) 
(16) 
For all 1. 
The matrix C is computed as: 
1 0 00 0 0 O 
0 0 O01 0 0 0 
C= Be! a8 Os ee ; ae : : gq 
0 0 00 0 0 1 0 0 
Oa) 


for i=1, 2..., q, and if Cee 0 
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if Oi ~ v for some i then the ith row in the (1-1) first block columns will be constituted from 


Si (v) where j is the number of the block column and * ~ eRe. 


2.4. Coprime Fractions 
Given a coprime right fraction G(s): 


G(s)=N,(s)D, (s) (18) 
If the fraction is column reduced then D(s) and N(s) can be written as: 


D(s)=D,, H(s)+D,, L(s) 


(19) 
N(s)=N,, L(s) 020) 
where 
1 
: 0 
se - 0 oo 
H(s)=| i 7. ¢ |L(s)= 
0 ee 1 
ae 
= (21) 
D,, ; Dd, and Nic are constant matrices. Hi; Is the column degree of D(s) for i=1, 2..., p. 
It was proven [21] that if a system is controllable and observable then: 
Ip_ —l 
_ | 
B, =D, (23) 
And by definition: 
=) —1 
G(s)=C(AI, — A)" B=N,(s)Dz(s) (24) 
Replacing (22) and (23) results in: 
Dp (s)=D,,6, (25) 
Ne (s)=CL(s) (26) 
Where: 
0.=H(s)—A.L(s) 7) 
Replacing (24) in (25): 
Dr (s) = D,,.H (s) = D,AUS) (28) 


This results in: 
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A =-D,'D 


r he ic? 


= el _ 
B. = Dy ? C=N,, (29) 


A 


B - 
‘and ‘are the nontrivial rows of A and B. 
The resulting minimal realization 1s in controller canonical form: 
a. Aisin general controller canonical form where 


u, rowofAisthel* rowof -Dix Dic 


(iq = fy)" row of A is the2”™ row of -Dhe~Dic 


b. Bis in general controller canonical form where 


uu, row of Bisthe 1” row of Diic™ 


(i+ 4) row of B isthe2™ row of Dic 


c C=Nlc 

The controller canonical form was obtained from a right coprime fraction. This is particularly 
interesting for controller design using pole placement [22]. If a left coprime fraction is used, the result 
is a minimal realization in observer canonical form. Both methods were implemented in the minimal 
realization toolbox. 


2.5. Realization from Frequency Domain Data: 

The first results for realizations based on frequency domain data using the Loewner matrix were 
presented in [6]. In this subsection we present the main results and a brief explanation of the procedure used 
to contrcut the numerical minimal realization. The resulting system is a descriptor system or also known as 
differential algebraic equations (DAE). It has the form: 


Ex = Ax+Bu 
y Cx+ Du 


If E is invertible, the standard state space form can be easily recovered. If E is singular some 
techniques exist to transform it to a standard state space provided that some conditions are met. More details 
can be found in [23-26]. 


(A3t5w,)t=1,...,k 


Given right frequency data: and left frequency data 


Sh* sv* ) j=1...,q. 
(u pre Prd J Tyne . The goal is to find a transfer function H(s) that interpolates this data such that: 


H(A, )r, =W, , ae A(u,)=v*, 


(30) 
Then one can regroup the data in matrices such that for right data: 
A 
A= “a eC 
A, 
R=[, 4 -- 74JeCc"™ 
xk 
W=|[w, w, --- wjeC’ (31) 
and for left data: 
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q q (32) 


, ; qxk 
Then from this data, one can contrcut the well known Loewner matrix LeC*” as follow: 


vit — Ly, VA —LhY, 
fy, —”, Hl, — A, 
L- ; 
vi — lw, Vt. — LW, 
MH, —” MH, —”, (33) 


This L matrix satisfies the Sylvester equation: 


LA —ML=VR-—- LW (34) 
qxk 
Then one also needs to contruct the shifted Loewner matrix such that: 
Vr —lwA AV, —lw”, 
LZ, L7 
ES : 
LV th, —lwA Heal —lw A, 
H, -_ A, H, 7 A, (35) 


wee , 
This * matrix satisfies the Sylvester equation: 


L.A—ML, =MVR-LWA (36) 


Then one can contruct a realization: 


R=-L,A=-L, ,B=V ,C=W ,D=0 (37) 


If the numerical minimal realization is to be computed and the numerical ” ank L=k compute the 


rank revealing SVD: 
= es * 
L=YuxX*~Y 2, X*, (38) 
Then the minimal realization is given by: 
F=-Y*, LX, ,A=-Y*,LX, ,B=Y",V ,C=WX, ,D=0 (39) 


The resulting system may be complex. A procedure was developed to recover the underlying real 
system. This procedure and the proofs for the results given above can be found in [27]. 
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2.6. Realization from Time Domain Data: 
The goal in this procedure is to interpolate the time domain input-output data by a descriptor system: 


Ex = Ax+Bu 
y 


Cx+ Du (40) 


To achieve this objective, a modified Loewner can be used [7]. This algorithm constructs a model 
for an LTI system directly from a single time domain input/output snapshot without prior knowledge of 
frequency response data. Of course, the more knowledge about the characteristics of the system, the more 
accurate the model will be. 

The input u and the output y of the system are measured with respect to time and recorded as vectors 
u and y with length K which corresponds to the number of samples taken. Kmin is selected as a quarter of K 
such that to ensure that the outputs have entered a steady state after kmin. n is an integer corresponding to the 
dimension of the model. 

The choice of the input u, the interpolation points and the number of samples K can be changed to 
best correspond to the system at hand including which range of frequencies is of importance. Specifically, the 
range of the possible interpolation frequencies that can be chosen is: 


9 


7 nF eR 
K K 


(41) 


Therefore, increasing the number of samples K, increases the range of possible frequencies. 
We used a modified version of that algorithm in our implementation to meet our requirements. 
For more details on the algorithm itself and its proof, please refer to [7]. 


3. RESEARCH METHOD 

There exist different algorithms each with its advantages and drawbacks. The best method depends 
on each specific application. This requires having a tool to be able to compare between the different methods 
and choose the most appropriate method for that specific application. This tool (or commonly called toolbox) 
is the minimal realization toolbox implemented in MATLAB and presented in this paper. MATLAB was 
chosen because it is used by a lot of researchers and engineers [28, 29]. All the methods presented in 
Section 2 were implemented in functions: Gilbert Method, Kalman decomposition, Hankel and SVD, Hankel 
and row searching, Left coprime fraction (LCF), Right coprime fraction (RCF), Interferq (from frequency 
domain data), Intertime (from time domain data). 

All the programmed functions are grouped in a toolbox for minimal realization. This toolbox can be 
easily used using the graphical user interface (GUI) shown in Figure 1. 

The GUI is divided into two main sections: The first one on the top left is the “interpolation and 
minimal realization” section where one can obtain a minimal realization from frequency or time domain data 
by pressing the appropriate button. In the second section, one can compute a minimal realzaition from a 
transfer function (TF). Six buttons corresponding to six minimal realization methods are available. Choosing 
a specific method will display the result of that method directly on the same view (Figure 1). Choosing 
another method will display the results of that method discarding the previous results. Finally on the top 
right, in the options section, one can load data, save the results to a matlab file or compare the different 
minimal realization methods available with a bode plot. Under these sections, we have five text fields 
displaying the matrices of the minimal realization. In the next section, the GUI is used to compute the 
minimal realization of practical problems. 


4. RESULTS AND DISCUSSION 
In order to test the methods for the minimal realization from a transfer function, a distillation 
column system is used [30]. The matrix transfer function 1s as follow: 


2.5815—6.746 5.9495+ 26.64 

_| +457 458 Ss +457 +58 

( = 4.0875+59.48  2.6225—54.94 
s+45° +55 s +457 +58 (42) 
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Entering this matrix transfer function into the GUI and choosing for example left coprime fraction 
results in the minimal state space realization shown in Figure 1. This can be done for all the other methods by 
selecting the appropriate button. 

Using the button “Methods’ comparison’, the methods can be compared in terms of their Bode plot 
where the transfer function 1s plotted in dots and the other methods as continuous line. For the example used, 
the resulting Bode plot is shown in Figure 2. 


Minimal Realization Toolbox 
State Space Representation 
inserpodaon and minimal realization Minimal Fteaizatos given a TE 


|Prequency domuin inieepolaSon | Daler! method Kaka decomeonton 1] AGF 











| 
= - = —_—_— = 
Tmt doman nepotaion: | Hankel ond Sy Hane and roe Searching LUE 


Figure 1. Minimal realization of a distillation column using the presented GUI 


Bode Diagram 


5-08 
B a | 
i 3 

gm 
- ] 


Frequency (recs) 


Figure 2. Bode plot comparison of the TF (dotted blue) and state space form (line red) 


The previous example allowed us to test the capabilities of the GUI. After few clicks, a minimal 
realization can be obtained using the chosen minimal realization method. This also permitted to determine the 
McMillian degree. Since the size of the matrix A is clearly 4 then the McMillian degree is 4. Also, based on 
the comparison of the methods, the Bode plot of the original system perfectly superposes with the resulting 
methods. This proves that these minimal realizations are indeed exact. 


4 

Since the algorithms have similar time complexities between ranging between O(n") and O(" ) ; 
the engineer or the researcher will generally choose the method based on the usefulness of the configuration 
of the state space representation. 

In order to test the Loewner method given frequency domain data, we use the beam example of 
order 348 from [31].The Loewner method allows to choose the numerical minial order based on the decay of 
singular values. In order to capture the behaviour of the system, the order is chosen to be 14. The results are 
shown in Figure 3. The original and resulting bode plots are depicted in Figure 5. 
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Finally in order to test the time domain Loewner method, we consider Penzl's time-continuous LTI 
system introduced in [32], which is investigated in the context of the Loewner approach. The data given is in 
form of input-output time domain data. Using the the button “time domain interpolation”. We obtain the 
system shown in Figure 4. A comparison between the bode plots of the original system and the interpolated 
system in descriptor form are shown in Figure 5. 


10919 77647 00566 00054 00173 90005 
75957 00461 00042 0.0090 0.0019 0.0026 
00479 00035 02294 02007 0.0116 0.0019 
00108 O0113 02109 O2774 OMGO4 O00ES 
00084 00012 0.0070 00021 01138 0.6189 0: 

OQ001T 0.0172 -0.09TT 

0001 

0.0003 0; 

0.0000 

00002 

0.0000 

Ooo - 

60000 


Columns 10 Beeagh 14 
“08002 2.0002 0.0001 


0 0056 
0.0001 00000 0.0002 4 ; 
2.0000 0.0000 0.0000 0.0000 9.0016 


Columns | Trough 9 
46951 50456 -027592 
Colurnns 10 through 14 
0.0009 0.0007 0.0002 


OO1t2 -O0212 G0000 -0.0031 





Figure 3. Result of the interpolation of the beam example as shown in the GUI 


Minimal Realization Toolbox 


7 





Frequency domam inteipolabon 


Time dome inketpolaten 


| i De-t4* 
| Golwmns 1 through & 


B0065 042 DORR Guy 0003 
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O5705 0.0002 
0.0002 9.1920 
o 0.0001 


M3859 2.2837 488099 -10.9604 10d -1.081e 0ST iS -0.0007 


Columns 10 threwgh 14 
1.0000 -0.0000 -0.0000 -0.0000 o.ODDD 


1 cametidi * 


Columns t menugh 


31725 -Q0084 0.0182 
B.0008 O02 DODDS » 


10008 o.191a 0002 
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0.0005 


O.Ob00 


Columns tO twough 14 


e000 o.0000 0.0000 
2.0000 
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0.0029 0.0003 
0.000% doe 


0.0 
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000 





Figure 4. Result of the Penzl example’s interpolation as shown in the GUI 
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Figure 5. Bode plot comparison for the beam example (left) and Penzl example (right) 


CONCLUSION 
A new Minimal realization MATLAB toolbox was implemented. Minimal realization is an 


important tool used to compute the state space representation of a system with a minimal number of states. 
The presented GUI and toolbox allows to compute and compare between different minimal realizations 
techniques for linear systems. Transforming the system to state space allows to use the rich theory available 
for systems in state space representation especially controller and observer design using pole placement. 


This toolbox works for both SISO and MIMO systems. The presented toolbox can be enhanced by 


incorporating controller and observer design algorithms. Some of these algorithms are already available as 
functions in MATLAB. 
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